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Abstract 

Energy harvesting multi-hop networks allow for perpetual operation of low cost, limited range 
wireless devices. Compared with their battery operated counterparts, the coupling of energy and data 
causality constraints with half duplex relay operation makes it challenging to operate such networks. In 
this paper, a throughput maximization problem for energy harvesting two-hop networks with decode-and- 
forward half-duplex relays is investigated. For a system with two parallel relays, various combinations 
of the following four transmission modes are considered; Broadcast from the source, multi-access from 
the relays, and successive relaying phases I and II. Optimal transmission policies for one and two 
parallel relays are studied under the assumption of non-causal knowledge of energy arrivals and finite 
size relay data buffers. The problem is formulated using a convex optimization framework, which allows 
for efficient numerical solutions and helps identify important properties of optimal policies. Numerical 
results are presented to provide throughput comparisons and to investigate the impact of multiple relays, 
size of relay data buffers, transmission modes, and energy harvesting on the throughput. 


I. Introduction 

Energy harvesting presents a new paradigm for eontinuous operation of eommunication sys¬ 
tems without the need for battery replaeement. Energy harvesting teehnology reduees the op¬ 
erational eost and allows off-grid deployment of sensor nodes such as the ones used within 
a human body, in nature, or on various structures. As a result, wireless nodes with energy 
harvesting capability are able to provide long-term data acquisition and monitoring of biological 
signals, environment and wildlife. An important issue in realizing energy harvesting networks is 
the stochastic nature of energy arrivals with low energy amounts. Therefore, the main concern 
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in energy harvesting wireless sensor network design is the efficient use and management of the 
harvested energy. 

Energy harvesting wireless sensor networks are typically operated over multiple hops to 
provide range extension and to lower power consumption which favors multiple short hops as 
opposed to one long hop. Operation over multiple hops brings in another challenge for efficient 
use of harvested energies; now multiple nodes have to be coordinated to allow for energy and 
data causality over each hop, necessitating the half-duplex relays to switch from reception to 
transmission modes as a function of the energy and buffer state of the whole network. The main 
goal of this paper is to study this problem in the case of two-hop networks involving one or two 
parallel relays under the offline optimization framework, which allows for non-causal knowledge 
of energy arrivals at all the nodes; see |[I1 and references therein for a detailed overview of offline 
energy harvesting communications systems. While assuming non-causal knowledge presents a 
simplified model, it allows us to uncover some of the important properties of optimal transmission 
policies, which determine when and how to use the relays optimally. The insights gained from our 
work can be used to move towards more practical solutions involving more hops and non-causal 
knowledge of energy arrivals as done in [[2l|. 


A. Contributions 

In this paper we investigate two-hop energy harvesting networks with half-duplex relay nodes 
that have limited size data buffers. We assume the relays employ decode-and-forward strategy, 
which is easy to implement in practice. Our goal is to maximize the total throughput delivered to 
the destination by a deadline. We first study the single relay case as shown in Figure |l(a)[ Under 
the offline optimization framework, we formulate a convex optimization problem and using the 
Karush-Kuhn-Tucker (KKT) conditions provide properties of optimal transmission policy that 
determines source and relay schedules and energy levels. 

We next consider a two-hop network with two parallel relays Q, also known as the diamond 


relay channel as shown in Figure |l(b)[ The capacity of the diamond relay channel is not 
known, and the highest achievable rates are based on various combinations of the following 
four transmission modes a, 0: i) Broadcast mode, in which the source (S') transmits and 
relays (i?i and R 2 ) listen; ii) the multi-access mode, in which Ri and R 2 transmit and the 
destination (D) listens; iii) successive relaying phase I, in which S and R 2 transmit, and Ri and 
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D listen; iv) successive relaying phase II, in which S and Ri transmit, and R 2 and D listen. We 
formulate a convex optimization problem that considers all four transmission modes jointly. In 
order to get insights, we investigate some important special cases: i) Successive relaying phases I 
and II, also known as multihop with spatial reuse; ii) broadcast and multihop with spatial reuse; 
iii) multi-access and multihop with spatial reuse. Using the convex optimization framework, we 
show that optimal transmission policies for the parallel relay case exhibit some characteristics 
that are different their single relay counterparts. Finally, solving the optimization problems, we 
illustrate the effect of multiple relays and energy harvesting on the throughput. We also study 
the impact of the relay data buffer size on performance. 

B. Related Work 

In recent years, there has been a surge of interest in energy harvesting communication systems 
where a significant effort has been devoted to the offline optimization framework; see |[I| and 10 
for a review of the recent developments. Here we summarize the papers that are closely related 
to our work. Optimal transmission policies for energy harvesting two-hop networks have been 
studied in fTl- llTSll . In 0 two-way relay channels with energy harvesting nodes are considered. 
Gunduz and Devillers study offline throughput maximization for two-hop communication with a 
full-duplex relay and with a half-duplex relay for single energy arrival at the source and multiple 
energy arrivals at the relay in |[8l. Similarly, multiple energy arrivals at the source and single 
energy arrival at the half-duplex relay is studied in |l9l. Our previous works ifT^ - lfTTIl also focus 
on a half-duplex relay, and for two energy arrivals at the source and multiple energy arrivals at the 
relay, identify necessary properties of an optimal transmission policy using heuristic arguments. 
In llT^ we extend our work in ifTOjl - lfTTll to include a convex optimization formulation for the 
case of a single relay and two relays employing multi-hop with spatial reuse. We also provide 
properties of optimal transmission policies using KKT conditions. The impact of data buffer size 
for a battery operated relay and a relay with one energy arrival is studied in lfT3]l . In addition, the 
throughput maximization problem with amplify and forward relaying, and relay selection problem 
are studied in [fT4l and [fTSll . respectively, with non-causal and causal channel and energy arrival 
information. In [fT^ Huang et. al. study the throughput maximization problem for the energy 
harvesting Gaussian relay channel and Yuyi et. al. in [fTTll investigate link-selection problem to 
minimize the average outage probability. Gurakan et. al ifT^ consider energy harvesting multi- 
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(a) (b) 

Figure 1. Two-hop communication with (a) one relay, (b) two parallel relays (diamond relay channel). The power gain between 
nodes k and I is au = \hkif where h^i is the complex channel gain, k = s,ri,r 2 ,r and I = ri,r 2 ,r,d. 


hop communication with energy eooperation, where the source can transfer some of its harvested 
energy to the relay. Along this line of work, the throughput maximization problem for two-hop 
energy harvesting network with energy transfer from the souree to the relay, and with two-way 
energy transfer from multiple source nodes are investigated in lfT9l and |[20l . respectively. 

Compared with our conference publieations ifTOl - lfT^ . this paper introduees a more eompre- 
hensive framework to study the parallel relay ease by introdueing all four transmission modes 
and by providing a detailed analysis of the optimal transmission policies. We also incorporate 
the data buffer size limitation at the relays. Furthermore, the numerieal results are extended to 
include comparisons of various combination of the transmission modes, and impaet of number 
of relays and relay data buffer size on performance. 

C. Organization of the Paper 

The paper is organized as follows. In the next section, we describe the system model and 
achievable rates for one relay and two relay cases together with some general properties of 
optimal transmission policies. In Seetion Hill we provide a convex formulation and investigate 
optimal transmission policies for throughput maximization in the one relay case. We also provide 
some properties of optimal power allocation. We formulate a convex problem for the case of 
two relays in Seetion HVl We investigate optimal transmission polieies for multi-hop with spatial 
reuse, broadcast and multihop with spatial reuse, and multi-access and multi-hop with spatial 
reuse in Sections IIV-A[ IIV-B[ IIV-CI respectively. In Section |Vl numerical results are presented, 
and Section |Vl] concludes the paper. 
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II. Preliminaries 

A. System Model 

We consider two-hop communication with energy harvesting source (S'), and one (i?) or two 
parallel (i?i and R 2 ) energy harvesting half-duplex relays as in Figure [IJ We assume that the 
relays have finite size data buffer with capacity Bmax bits. There is no direct link between the 
source and the destination, and the relays cannot hear one another as in |l5l . Each link is modeled 
as having independent additive white Gaussian noise with unit variance. The complex channel 
gain between node k and I is hki where k = s,ri,r 2 ,r, and I = ri,r 2 ,r,d, and remains constant 
throughout transmission. The corresponding power gains are aki = For the two relay 

case, without loss of generality we assume asn > We assume that energy arrives at the 
source and relays with arbitrary and finite amounts at arbitrary times until a given deadline T 
seconds. For ease of exposition, we combine all energy arrivals at the nodes in a single time 
series to = 0,... Rk < T hy allowing zero energy arrivals at some time instants at which only 
one of the nodes harvests energy. We denote harvested energy amounts at time U by Eg^i, Er^^i, 
and Er 2 ,i for S, Ri and R 2 , respectively, for one relay), i = 1,..., K. In addition, we assume 
that each node has separate infinite size battery and harvested energies are stored in the batteries 
without any energy loss. We also assume that there is no energy loss in retrieving energy from 
the batteries. The time interval between two consecutive energy arrivals fj_i and tj is denoted 
by Ti ^ ti — ti_i, and it is called the Tth epoch. 

Our goal is to maximize the total data delivered to the destination by a given deadline 
t = T which is referred to as the throughput maximization problem |l6l. We consider offline 
optimal transmission policies, that is, we identify optimal power allocation for each node and 
the transmission schedule assuming that all energy amounts and arrival times are known at the 
nodes before transmission starts. Here, the transmission schedule indicates which node transmits 
when, and it is necessary to coordinate the operation of the half-duplex relays. We assume that 
the nodes consume energy only for transmission. Due to energy arrivals over time, any feasible 
transmission policy must satisfy energy causality constraints. Energy causality constraints refers 
to the restriction on the total consumed energy of a node at time t which should be less than 
or equal to the total harvested energy at that node by that time. In addition, there are data 
causality and finite data buffer constraints on the feasible transmission policy. The data causality 
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Succesive Relaying Phase I Succesive Relaying Phase 11 


(b) 

Figure 2. Transmission modes with (a) one relay, (b) two parallel relays (diamond relay channel). 


constraint states that data transmitted by any of the relays up to time t should not exeeed total 
data reeeived by that relay up to that time. The finite data buffer eonstraint suggests that eaeh 
relay ean store at most Bmax bits of data in its buffer. We assume both relays have the same 
size data buffer for simplieity; our results ean easily be extended to the ease when eaeh relay 
buffer is of different size. 

B. Achievable Rates 

In this paper, we eonsider Shannon eapaeity as the rate-power funetion of a given link, i.e., 
C{p) = log(l + ap) where a = \h\^ is the power gain of the link and p is the transmission 
power. 

In the single relay ease, when the transmission powers of S and R are Ps and p^, respeetively, 
we have the data rates from S' to (first hop in Figure |2(a)| ) and Rio D (seeond hop in Figure 
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2(a)) respectively as 


and 


Cs = log(l + asrPs), 


( 1 ) 


Cr = \og{l + ardPr)- (2) 

In the two relay case, there are four transmission modes as shown in Figure [2] We will 
assume that Ri and R 2 do not beamform towards the destination, hence we will only focus 
on independent information transmission to and from the relays. While beamforming increases 
achievable rates, it also requires tighter coordination and synchronization among the relays [|2T]| . 
which may be difficult to achieve for energy harvesting networks typically consisting of small 
and inexpensive nodes. 

• Broadcast mode: S broadcasts independent information to Ri and R 2 resulting in the rate 
region [|22]| 


Cbr^ < log(l + pasr^Pb) 

(3) 

/ 1 , iX-p)asr2Pb\ 

Cbr^ < log 1 + , 1 ’ 

2 V pasr2Pb + 1 / 

(4) 


where pb is the source power used in the broadcast mode and rj is the power sharing 
parameter such that rj portion of the power is used to transmit data to Ri. Here, is the 
data rate from S to Ri, and Cb^^ is the data rate from S to R 2 . 

Operating on the boundary of this rate region, the required transmission power of the source 
Pb can be computed as 

Pb = (— - —) - ^ + . (5) 

\^sr2 ^ST\ / ^ST2 ^sri 

Note that is convex function of and For notational convenience, we will use 
fbcicbr -^, Cb^^) to denote the right hand side of ([5]). 

. Multi -access mode: Ri and R 2 jointly send information to D which uses joint decoding. 
Denoting the transmission powers of Ri and R 2 in multi-access mode as pr^m and Pr 2 m, 
respectively, we obtain the following rate region for the multi-access mode [|23 


^rim 
^r2m 
Cnm “h ^7*2771 


< log(l + ar^dPnm) 

< log(l + ar^dPr 2 m) 

— log(l “f OiridPrim “f Oir^dPr^m) 


( 6 ) 

(7) 

( 8 ) 
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where Cr^rn and Cr^m refer to the data rates from Ri and R 2 to D, respeetively. 

For notational eonvenienee, we define the following eoneave and non-deereasing funetions. 

frimiPrim') lo§(l “f OiridPrim) j (9) 

fr2m{^Pr2m) le§(l “f ^r2dPr2m): (10) 

frmiRrim)Pr2m) loS(l ^ridPrim “f ^r2dPr2m) ■ (11) 

• Successive relaying phase I: While S transmits to Ri, R 2 transmits to D with transmission 
powers psi and Pr 2 i, respeetively. Aeeordingly, the data rates from S to Ri and from R 2 to 
D are given by 

Csl = log(l -f asr^Psl), (12) 

and 

Cr^I = log(l -f arjdPrs/), (13) 

respeetively. 

• Successive relaying phase II: While S transmits to R 2 , Ri transmits to D with transmission 
powers Psii and Pr 2 ii, respeetively. Aeeordingly, the data rates from S to R 2 and from Ri 
to D are given by 

CsH = log(l + asr 2 PsIl), (14) 

and 

Crj^II = log(l -f aridPnll), (15) 

respeetively. 

The following lemmas establish some properties of the optimal transmission polieies. 

Lemma 1: In an epoeh, eonstant power transmission is optimal. 

Proof: The proof follows from the eoneavity of the rate-power funetions and Jensen’s 
inequality ll22]| . First, we argue this for the point-to-point links. Consider any transmission poliey 
for whieh the transmission power ehanges in an epoeh. We ean find another transmission poliey 
whieh has eonstant transmission power sueh that the new poliey eonsumes the same amount of 
energy as the previous one. However, due to eoneavity of the rate-power funetion, the new poliey 
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transmits more data [|23l|. For the single relay ease (Q-©) and successive relaying phases I and 
II ( (fT^ - (fT5l) ') point-to-point rate-power functions apply and hence optimality of constant power 
transmission in an epoch is established. For the broadcast mode, the proof follows from the strict 
convexity of the transmission power as a function of the data rates as given in ® and for the 
multi-access mode, it follows from the concavity of the rate region as a function of the 

transmission powers and Pr- 2 m- As a result, we can conclude that the constant transmission 
policy is optimal for both single and two relay scenarios. ■ 

Lemma 2: Given a feasible transmission policy for which a relay is not on, i.e., not transmit¬ 
ting or receiving data all the time, we can find another feasible transmission policy that ensures 
the relays are always on without decreasing the throughput. 

Proof: Consider a feasible transmission policy for which one of the relays (or the relay 
in the case of a single relay) is not always on. We can remove the idle times by increasing 
transmission duration of another node (source or the other relay) while keeping total transmitted 
data the same. Due to monotonically increasing property of the rate-power functions (fTI)- (fT5l) . 
the new policy delivers the same amount of data to the destination and consumes less energy; 
hence, it is feasible. ■ 

Lemma [T] suggests that the transmission powers of the source and the relays remain constant 
within an epoch. In the following discussion, i = 1,K refers to the epoch index. Accordingly, 
for the single relay case we denote the transmission powers of S and R by j and pr^i with 
corresponding durations j and respectively. For the case of two relays, we denote the 
transmission powers of S for the broadcast mode by pb^i with duration Ib^i. For successive relaying 
phases I and II the transmission powers of S are denoted by pspi and Psii,i with durations Ipi 
and respectively. The transmission powers of Ri and R 2 in multi-access mode with duration 
lm,i are denoted by Prim,i and Pr 2 m,i, respectively. For successive relaying phases I and II the 
transmission powers of Ri and R 2 are denoted by p^pi and Pr 2 ipi, respectively. As argued in 
Lemma m without loss of generality transmission policies can be restricted to the ones for which 
the relays Ri and R 2 are always on. Therefore, we consider that the transmission time between 
S and Ri, and R 2 and D are the same in successive relaying phase 1. Similarly, we consider 
the same transmission time between S and Ri, and R 2 and D in successive relaying phase 11. 
Accordingly, while evaluating the rates in (fTI)-(fT5]) during an epoch, the corresponding powers in 
that epoch will be used along with subscripts i in the rate variables to indicate the epoch index. 
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III. Two-hop Communication with One Relay 

In this section, we investigate the throughput of the single relay case shown in Figure |l(a)[ 
and consider the achievable rates in O and (l2l). Since constant power transmission in each epoch 
is optimal by Lemma [H it is sufficient to consider data causality and buffer size constraints only 
at energy arrival times. 

Lemma 3: For the single relay case, in an optimal transmission policy, S and R deplete their 
batteries and transmit same amount of data until the deadline. 

Proof: Suppose both S and R have non-zero energy in their batteries at time T, and the 
transmitted data by S is more than R. First, we show that given any feasible transmission 
policy for which the battery of R has nonzero energy at the deadline T, we can find another 
policy which delivers as much as data by depleting all the energy in the battery. This follows 
from the fact that the rate-power function in Q is monotonically increasing function of power. 
Therefore, the relay can use this excess energy to increase its transmission power in the 
last epoch while reducing the transmission duration such that the delivered data remains the 
same. While keeping the consumed energy the same, increasing transmission duration strictly 
increases transmitted data [|2^ . Therefore, the new policy can be replaced by another policy 
such that the transmission duration of S in the last epoch, is increased while the last 
relay transmission is postponed towards to the deadline. Therefore, in the new policy the source 
delivers more data than the previous policy. We can further increase the total transmitted data 
by S by depleting all the energy in its battery. As a result, the new policy depletes the batteries 
of S and R with the source transmitting more data than the initial policy. Now, this policy can 
be replaced by another one of higher rate obtained by increasing the duration of the last relay 
transmission while decreasing duration of the preceding source transmission under data causality 
and relay buffer size constraints. Combining these, we can find a feasible policy transmitting 
higher data such that source and relay deplete their batteries and transmit same amount of data 
until the deadline. ■ 
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Based on the above arguments, the throughput optimization problem ean be formulated as 
follows, where the maximization is over Ps,h lr,h and i = 1,K: 


K 


max 


^ ^ /j. j log(l -f OirdPr,i} 

i=l 

i i 

S.t. 'y ^ ^r,jPr,j ^ E Vz, 

i i 

^ ^ ^s,jPs,j E ^ ^ Vz, 

i=i i=i 

i i 

^ ^ lr,j lo§(l “f (^rdPr,j) E ^ ^ lo§(l OlsrPs,j)^ 


i=i 


i=i 


^ ^ ^s,j lo§(l “f OlsrPsj) E ^ ^ ^r,j lo§(l OlrdPr,j) “f Bjyiaxy 
i=i i=i 

d E Pr^i: d E Psd^ d E ^r ,25 d E ^s,ii ^^5 


(16a) 

(16b) 

(16e) 

(16d) 

(16e) 

(16f) 

(16g) 


where the eonstraints in (I16bl) . (I16el) are due to energy eausality at R and S, respeetively, and 
the eonstraints in (I16dl) and (I16el) are due to data eausality and finite data buffer size at R. The 
half-duplex eonstraint appears in (I16fl) . Note that sinee the total amount of data delivered to D is 
equal to the amount of data transmitted by R, the throughput maximization problem eorresponds 
to maximization of the total data transmitted by R as in (I16al) whieh is equal to (I16dl) evaluated at 
i = K. The above optimization problem is not eonvex beeause of the eonstraints in (I16bl) - (ll6el) . 
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We rewrite (fT^ in terms of Cs^i, lr,i, and ls,i as follows: 


K 


max 


Cr,i 


2 = 1 


i = l 




i=i 




i=i 


i=i 


y~~! — y~~! ^s,j ; Vi, 


i=i 


i=i 


^ ^ Cgj ^ ^ ^ Cj’j’ -f B^naxi Vi, 
i=i j=i 

^r,i “f ^s,2 ^ ^25 Vz, 

0 ^ 0 ^ Cs,Z7 0 ^ ^r,ii 0 ^ ^s,25 Vz. 


(17a) 

(17b) 

(17c) 

(17d) 

(17e) 

(17f) 

(17g) 


Note that is perspective of the convex function 6'^’’% hence it is a convex function of 

^r,i ^3,i 

lr,i and Cr,i ll24l . Here, we consider = 0 when = 0. Similarly, in (I17cl) is a 

convex function of Ig^i and Cg^i. Therefore, the optimization problem in (fTVl) is convex and can 
be efficiently solved ll2^ . 

The solution of the optimization problem provides the optimal transmission powers of S and 
R and their durations for each epoch, but we need to schedule the transmissions to obtain a 
feasible policy. Within an epoch, moving transmission of source to an earlier time by delaying 
relay transmission maintains optimality provided the relay data buffer does not overflow. This 
is because postponing the transmission of R allows the relay to store more energy and data. 
Therefore, without loss of optimality, we will consider transmission policies such that in each 
epoch, the source transmits until the data buffer of the relay becomes full, or the source reaches 
its optimal transmit duration, which is followed by relay transmission until the data buffer of 
the relay becomes empty, or the relay reaches its optimal transmit duration in that epoch. The 
source and relay take turns in this fashion until the end of the epoch. 

Next, we identify properties of the optimal transmission policy using KKT conditions which 
are both necessary and sufficient due to convexity of the optimization problem in (fTTI) . These 
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properties provide the optimal structure of the transmission policy and are useful in designing 
online algorithms; for example see [|3- 

The Lagrangian of (fTTI) is defined as follows: 


K 


K 


i=l i=l 

K 


0=1 




i=i 


K 




i=i 


i=i \j=i 


i=i 


K 


^ ^ ^5,i i^r^i T ^s,i Ti) 


i=l 

K 


i=l \j=l 

K / i i 

i=l \j=l j=l 

K K K 

+ Y + Y + Y E Ag.C.,, 

2=1 2 = 1 2=1 2=1 

where Xj^i > 0, j = 1,..., 9 are KKT multipliers corresponding to (I17bl) -( [T7^ . 
Differentiating the Lagrangian with respect to and Cs,i, we obtain the following: 


(18) 


K 


K 


K 


- 1 - -— Y ^37 “ Y1 ^3j + Y - 0, 

^rd 

’ 3=i J=i 3=^ 


dC 


e 


K 


K 


K 




Y "^27 + Y ^3j “ Y 


(19) 


( 20 ) 


j=i j=i j=i 

Using (fT9l) and replacing with /r^jlog(l + ardPr,i), we can obtain the optimal relay trans¬ 


mission power p* • as: 


Pr.i = 




'^1,7 


'3 = 1- ' _ 1 

^rd 


( 21 ) 


where [x]’*' = max{0, x}. 

Similarly using (l20l) and replacing Cs^i with j log(l + Q:sj,Ps,i)’ *^he optimal source transmission 
power p* j becomes: 


Ps,i = 


T.f=i^3,j-T.f=i 1^4, j _]_ 

Y.f=i >'2,j “S’- 


( 22 ) 


Lemma 4: For the single relay case, whenever p*j strictly increases from epoch i to z + 1, 
either the battery or the data buffer of R must be empty at t = L, and whenever p* ^ strictly 
decreases from epoch z to z + 1, the data buffer of R must be full at f = tj. 

Proof: We provide a proof using the KKT conditions; alternatively a proof by contradictions 
as in ttlol Lemmas 4, 5, 7], is also possible. From the complementary slackness conditions, we 
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can argue that whenever Ai,i > 0 , the battery of R must be empty at time fj, and whenever 
As j > 0, the data buffer of R must be empty at time U. From (|2T]) . we observe that whenever 
Pr,i < Pr,i+V either Ai * > 0 or As j > 0 or both, henee proving the lemma. Similarly, from the 
eomplementary slaekness eonditions, we ean argue that whenever A 4 j > 0, the data buffer of R 
must be full at time ti. Sinee p*^ > implies X 4 ^i > 0, the proof is eomplete. ■ 

Lemma 5: For the single relay ease the optimal transmission power of S is non-deereasing, 
and whenever p* ^ strietly inereases from epoeh i to z + 1, either the battery of S must be empty 
or the data buffer of R must be full, or both the battery of S and the data buffer of R must be 
empty at t = U. 

Proof: From the eomplementary slaekness eonditions, we ean argue that \ 2 ,i > 0 implies 
the battery of S must be empty at time ti, As,i > 0 implies the data buffer of R must be empty 
at time U, and A 4 > 0 implies the data buffer of R must be full at time U. Below we investigate 
different eases for A 2 ,i, As,* and A 4 ,j. Sinee the data buffer of R eannot be full and empty at the 

same time, the eases (A 2 ,i = 0, As^j > 0, and A 4 ^j > 0) and (A 2 ,i > 0, As^j > 0, and A 4 _j > 0) 

never happen. Note that (A 2 ,j = 0, As,* = 0) and (A 2 ,i > 0, As,* = 0) were studied in [[TOl Lemma 
5]; a simpler proof using (l22l) is presented here. 

1) If A 2 ,i = 0 , As,* = 0 , and A 4 ,i = 0 , p* i = p* ^+ 4 . 

2) For the eases (A 2 ,i > 0, A 3 ,* = 0, and A 4 ,* = 0), (A 2 ,* = 0, A 3 ,* = 0, and A 4 ,* > 0), and 

(A 2 ,* > 0 , As,* = 0 , and A 4 ,* > 0 ), we have ^ < p*,*+i. 

3) For the eases (A2,* > 0, A3,* > 0, and A4,* = 0), and (A2,* = 0, A3,* > 0, and A4,* = 0), we 

argue by eontradietion that p* ■ < p*,*_,_i. Note that A2,* = 0, A3,* > 0, and A4,* = 0 implies 
P*s,i > P*s i +1 by db’ henee the argument below also suggests that this ease never happens. 
Suppose p* i > p*,*+i. We ean then equalize the power levels p* i and p*,*+i sueh that 
the new transmission durations and power levels are /' = {lsi + Isi+i )-,— * * —, 

’ ’ ’ 's.iPs.i+'s.i+lPs.i+l 

'P* .-\-p* 

l's,i+i = h,i + h,i+i - l's,i^ and pL = p' ,*+i = xhe new poliey has the same total 

eonsumed energy but S transmits more data due to the eoneavity of the rate-power funetion. 
Sinee we assume that p* ^ > Ps,*^!, the new transmission duration of pL must inerease, i.e., 
I'si > For the equalized powers, we ean obtain another feasible transmission poliey by 
inereasing total transmission duration of R and deereasing transmission duration of S and 
equalizing the transmitted data. As a result, this leads to a poliey with higher throughput 
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than the original one, which is a contradiction. Hence, P*s,i < Pi i+ 1 - 


IV. Two-hop Communication with Two Parallel Relays 


In this section, we consider the two parallel relay case as shown in Figure |l(b)[ We will 
formulate an optimization problem which includes all four transmission modes given in Section 
III-BI Then, to get insights we will investigate special cases by restricting our attention to select 
few modes. 

For ease of exposition, we consider two data buffers, and Br 2 to which data received by 
Ri and R 2 are stored, respectively. The amount of data stored in buffer in epoch i consists 
of j bits in the broadcast mode and c^/j bits in successive relaying phase I. The amount of 
data removed from B^.^ in epoch i consists of bits in the multiple access mode and 
in successive relaying phase II. Similar arguments for buffer can also be made. Note that 
and Br 2 are upper bounded by B^ax bits. 

In order to formulate a convex optimization problem for maximizing the throughput we define 
auxiliary variables and where er^rn,i = lm,iPrini,i and er 2 m,i = lm,iPr 2 m,i- These 

correspond to the energies allocated by Ri and R 2 , respectively, to the multiple access phase in 
epoch i. Based on the above arguments, the throughput maximization problem for the two relay 
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case can be formulated as follows: 

K 

na&X ^ ^ CriII,i C'P2l,i ~\~ CrjTTiji Cr2m,i 


2=1 


S.t. Cf^rn^i ^ 


rim 


Cr 2 m ,2 ^ ^m^ifi 


r2m 


■'rim,i 




■^r2m,i 




^rim,i Cy2?n,2 ^ ^m,i fr 


, Vi, 


, Vi, 


^rim ,2 ^r2m,i 


I • ’ / / ’ 

*'m ,2 ‘'772,2 / 


Vi, 


(23a) 

(23b) 

(23e) 

(23d) 


^ ^ (fej/fec 

i=i 


C 6 ^^,j (^br2,j\ . h.i ( 4^ 




^T'ld 
Jj . ( ‘'ryJJ 

—— I e 

7 = 1 


b,j ^b,j 

rill,j 


+ 


I,j 


a 


sri 


e ‘I’i — 1 + 


'^11,3 


a 


1 ’ / 

^h.i f^h,j 

1 j H“ ^7*1 mj ^ E Er^J, Vi, 


sr2 




i=i 


1 ] H~ ^2’2772,J ^ E Er2,ji Vi, 

/ j=l 

2 2 

^ ^ ^rill,j “t“ ^ ^ V ^s/j; Vi, 

2 2 

^ ^ ^r2lj V ^r2mj — ^ ^ ^sll,j V j, Vi, 


2 


J = 1 


^ ^ ^br^J V ^slj — ^ ^ ^rillj V ^ri7T2,J V ByjidX'i Vi, 


2 


2 


^ ^ ^sIIJ “t“ ^br2',j — ^ ^r2l,j ”V C'P2m^j V ByjidX') Vi, 

^7,2 V ^77,2 “1“ ^6,2 “1“ ^772,2 ^ "^25 '^il 


0 ^ 0 — ^br2,i') 0 — ^sl,i') 0 ^ CgJJ^i^ 0 ^ 0 ^ Cr27,2; Vi, 

0 ^ 0 ^ ^r2772,2; 0 ^ ^6,2; 0 — ^7,2; 0 ^ ^77,2; 0 ^ ^772,2 ; Vi, 

n < p ■ 0 < p V? 

u E;;;, ‘^ri„772,25 — ‘^r2p772,25 ''‘'5 


e '"J “ 1 ) - X] Es,j,yii23e) 

i=i 

(23f) 

(23g) 

(23h) 

(231) 

(23j) 


(23k) 

(231) 

(23m) 

(23n) 

(23o) 


Here the maximization is over c,. 2 /,i, Crim,ij Cj’jrrijij b,ij bl,i^ 

lm,i, and 6 ^ 2 ^™,,^ The eonstraints in (I23bl) - (l23dl) eorrespond to the rate region of the multi¬ 

access mode as in db])-®. The eonstraints in (l23el)-([23^ are the energy eausality eonstraints at 


July 14, 2015 


DRAFT 























17 


S, Ri, and R 2 , respectively. The constraints in (I23hl) - (l23il) are the data causality constraints 
at data buffers and Br 2 , respectively. The finite data buffer size constraints at Ri and R 2 
are given in ( |23j| )- (l23kl) . respectively. In addition, due to half-duplex constraints, transmission 
durations li^i, ln^i, Ib^i, and lm,i must satisfy (12311) . 

As discussed in Section HTBI fbc{cbr^,i,Cb^ 2 ’^^ convex function of Cb^^^i and Therefore, 
h if be i - 7 ^, - 7 ^ ) is the perspective of a convex function. Furthermore, as discussed in Section 

’ Y ^b,i ^b,i J 

Hm le~i is the perspective of the convex function In addition, the functions fnrn, fr^m, frm, and 
their perspective functions are concave. Hence the optimization problem in (l23l) is convex, and 
efficient numerical solutions exist Il24l . However, due to the large number of variables involved, 
it is difficult to get insights from the analytical solutions. Below, we focus some special cases: 
(i) multi-hop with spatial reuse in which there are two transmission modes, successive relaying 
phases I and II; (ii) broadcast and multi-hop with spatial reuse in which we have the broadcast 
mode as well as successive relaying phases I and II. (iii) multi-access and multi-hop with spatial 
reuse in which we have the multi-access mode in addition to the successive relaying phases. 

We first focus on multi-hop with special reuse as it is known to perform well in a wide range 
of channel conditions and is capacity achieving in certain cases [|4l. Furthermore, it is simple 
to implement. However, depending on the energy arrival profile and power gains there can be 
some unused capacity in the first or the second hops [|5l|. In such cases, we will observe that 
adding the broadcast or the multiple access modes enables a more efficient use of the harvested 
energy. 


A. Multi-hop with Spatial Reuse 

Multi-hop with spatial reuse refers to successive uses of phase I and II relaying. Our goal 
in this subsection is to specialize the general formulation of (1231) to multihop with spatial 
reuse to identify some of the optimal transmission policy using KKT optimality conditions. 
Since R 2 initially has no data to transmit in phase I, without loss of generality, we assume 
it starts transmission by delivering e > 0 amount of dummy information. By keeping e small 
and scheduling phases I and II in succession, we can ensure that there is no further loss in 
the throughput. Then, omitting e for convenience, the throughput optimization problem can be 
formulated by setting er^mp Cr^mp Cb^^,i, and Cb^^,i in ([231) to zero for 

i = 1 , 
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As in the single relay ease of Seetion Hill forming the Lagrangian and equating its derivatives 
to zero we obtain: 



(24) 


(25) 


(26) 


(27) 


^sr2\ 

, and Aio,i, i = 1, ...,76 are the Lagrange multipliers for the 


where Ae,^, Ay^*, Ag,^, Ag^j, 


eonstraints in (I23el) - (l23kl) . respeetively. 

Lemma 6: For multihop with spatial reuse whenever the optimal transmission power of a 
relay p*^jj j or p*^j ^ strietly inereases, either the battery or the data buffer of that relay must be 
empty, and whenever the power of a relay strietly deereases, the data buffer of that relay must 
be full at time t = U. 

Proof: The proof is similar to that of Lemma IH We only prove for Ri, similar arguments 
ean be made for R 2 as well. From (l24l) . we have p*^ii^i+i — P*r^n,i > 0’ when either Ay,* > 0 
or As* > 0. Using eomplementary slaekness eonditions, we know that Ay * > 0 implies all the 
data in Ri must be delivered at the end of the epoeh i, that is, the data buffer of Ri is empty. 
Similarly, whenever As,* > 0, the battery of Ri must be depleted at the end of the epoeh i. 
In addition, we have — P*i//,* < 0, when Ag,* > 0. From the eomplementary slaekness 

eonditions, we ean argue that whenever Ag,* > 0, the data buffer of Ri must be full at time 
t = ti- Henee, the lemma must be true. ■ 

Lemma 7: For multihop with spatial reuse whenever the optimal transmission power of S in 
phase I (phase II) strietly inereases from one epoeh to the next, i.e. fspi < (p://,* < 

p*ii i_^_i), either the battery of S must be empty, or the data buffer of Ri (R 2 ) must be full at 
t = ti, and whenever it deereases, i.e. ^ > p*/,*+i (Ps//,i > P*sii,i+0^ the data buffer of Ri 
(R 2 ) must be empty at f = f*. 

Proof: From the eomplementary slaekness eonditions, we ean argue that whenever A 4 ,i > 0 , 
the battery of S is empty at f = f*, and whenever Ag,* > 0, the data buffer of Ri must be full at 
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time t = tj. In addition, whenever > 0, the data buffer of Ri is empty at f = fj. From (|2^ . 
we see that p*j ■ < p*j implies X 4 ^i > 0 or Ag^j > 0 and henee the battery of S is empty or 
the data buffer of Ri is full. Similarly, p*j ■ > p*j implies Ay^j > 0 and henee the data buffer 
of Ri is empty. The same argument can be made for phase II and i ?2 as well. ■ 

Lemma suggests that the structure of the optimal relay transmission power for the two relay 
case when multihop with spatial reuse is employed is similar to that of a single relay established 
in Lemma IH However, comparing Lemma |7] with Lemma [5j we observe that unlike the single 
relay case where the source power is non-decreasing, in the two relay scenario, the transmission 
power of the source may decrease when the data buffer of the respective relay is empty. 

For the single relay case, as argued in Lemma [3] batteries of both S and R are depleted by 
the deadline. This is accomplished by adjusting transmission durations and powers of S and R 
to equalize the two-hop rates until both batteries are depleted. However, for the case of multi¬ 
hop with spatial reuse, simultaneously adjusting the transmission durations of S, Ri and i ?2 to 
deplete all the batteries may not be possible. Depending on energy profiles at the nodes, the 
maximum total rate transmitted from S to Ri and i ?2 can sometimes be more than the total 
rate Ri and i ?2 can deliver to D, resulting in excess energy at S' at f = T. Similarly, there may 
be remaining energy at Ri and/or at R 2 at t = T. The following lemma discusses this excess 
energy case. 

Lemma 8: In the optimal transmission policy for multihop with spatial reuse, if S has positive 
energy in its battery at t = T, then the batteries of both Ri and R 2 must be empty. 

Proof: The proof is by contradiction. Without loss of generality, assume that in an optimal 
policy both S and Ri have positive energy in their batteries at / = T. Then, we can increase 
the total data delivered from S to Ri and from Ri to D by increasing the last transmission 
powers Psi,K and PnipK, such that all the energies depleted. This results in a contradiction, 
hence proving the lemma. ■ 

As argued above and in Lemma [H either S, or Ri and/or R 2 may have positive energy in their 
batteries at / = T. When there is energy left at either of the relays’ batteries, the broadcast mode, 
used in conjunction with multihop with spatial reuse, helps deliver more data to the relay(s), 
enabling them to use their excess energy. Similarly, when there is excess energy at S' at / = T, 
the multi-access mode allows an increase in the data rate the relays can deliver, thus creating 
an opportunity for S to use its remaining energy. 
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B. Broadcast and Multi-hop with Spatial Reuse 


In this section, we consider the broadcast mode and successive relaying (phases I and II) jointly. 
In this case, S can either broadcast to the relays, or can transmit messages at different times using 
successive relaying. Similar to Section IIV-A[ we identify properties of the optimal transmission 
policies using KKT conditions. The throughput maximization problem can be formulated by 
setting Ifn^i^ and 0 ^ 2771 ,i to zcro for all z 1 , ..., K. 

Formulating the Lagrangian as in Section IIV-AI with KKT multipliers A 4 j, A 5 *, Ae,,, A 7 j, 
As,^, Ag^j,, and Aio,i corresponding to the constraints in (I23el) - (l23kl) . respectively, we obtain the 
optimal transmission power of S in the successive relaying modes, p*j i and as in (|2^ and 
(I 27 ]) . respectively. Similarly, we obtain the optimal transmission powers of Ri and R 2 in the 
successive relaying phase II and I as in (l24l) and (1251) . respectively. 

In order to obtain the transmission power of S in the broadcast mode we take the derivative 
of the Lagrangian with respect to and Cb^^^i, respectively, and set them to zero. 


dC 


,i~^^bT2 1 
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dCbr, ,i 


dC 
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sri 


+ X] -^7,i - Ag^j + - 0 , 


(28) 
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j=i 


Cr c 
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Asj - y^ Aioy + ,i-0(29) 

y j=i j=i j=i 

The KKT multipliers > 0 and > 0 are due to non-negativeness of Cb^^,i and Cb^^,i, 

respectively. 

Using ©, we compute the optimal power of S in the broadcast mode from (1281) and (l29l) as 


Ylf=i ^7,j ~ ^t=i -^9.2 + . 


K 


Pb,i = 


Ef=. A4„ 


■J=l ■ 


Of 


sr2 




Ylf=i Asj - Ylf=i AlO,i + ,i 


Ylf=i A4,j 


a 


(30) 


(31) 


sr2 


jj=i ■ 

Without loss of generality, we can restrict the optimal transmission policy such that the 
broadcast mode occurs only when S transmits to both relays. This is because if in the broadcast 
mode the source only transmits to one of the relays, say i?i, then this means R 2 will not be 
on. Using Lemma [2l we can replace this with another strategy for which R 2 transmits to the 
destination while S transmits to Ri, thus adding to the duration of successive relaying phase 1. 
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Therefore, we have Vi > 0, where Vi is the power sharing parameter in the broadeast mode as 
in ©. 

Lemma 9: For broadeast and multihop with spatial reuse, whenever the optimal transmission 
power of S in broadeast mode strietly increases from one epoch to the next, i.e. pl^ < ph+v 
either the battery of S must be empty or the data buffer of R2 must be full at f = U, and 
whenever it decreases, the data buffer of R 2 must be empty at f = fj. 

Proof: The proof is a simple extension of the proof of Lemma |71 ■ 

Lemma 10: In the optimal transmission policy for broadcast and multihop with spatial reuse, 
whenever the data rate from S to R2 in the broadcast mode increases, i.e., < Cb^^,i+i, where 

Cferj,* given in ([5]), either the data buffer of Ri or battery of S must be empty, or the data 
buffer of R2 must be full at t = L. Whenever the data rate from S to R2 in the broadcast mode 
decreases, i.e., Cb^^,i > Cb^^,i+i, either the data buffer of R 2 must be empty or the data buffer of 
Ri must be full at t = U. 

Proof: Combining (1^ and (l3TI) . we obtain 




(32) 


0 when Cb^^^i and Cb^^^i are positive. 


From complementary slackness conditions, we can argue that when A 4 > 0, the battery of S is 
empty at t = U, when As,* > 0 and > 0, the data buffer Br^ and Br^ are empty at t = U, 
respectively, and when Ag^j > 0 and Aio,* > 0, the data buffer and B^.^ are full at t = L, 
respectively. Hence to have Cb^^^i < Cb^^^i+i either the data buffer of Ri or battery of S must be 
empty, or the data buffer of R 2 must be full. Similarly, to have Cb^^^i > Cb^^,i+i, either the data 
buffer of R 2 must be empty or the data buffer of Ri must be full. ■ 

C. Multi-access and Multi-hop with Spatial Reuse 

In this section, we consider the multi-access mode and successive relaying phases I and II 
jointly. The throughput maximization problem can be formulated by setting Cb^^^i, Cb^^^i to 
zero for i = I ,..., K in (l23l) . 

Formulating the Lagrangian with KKT multipliers A^,*, k = 1,...,10, corresponding to the 
constraints in (I23bl) - (l23kl) . respectively, for i = we obtain the optimal transmission 

power of S is as in Section HV-A[ that is, p*j ^ and p*jj^i are equal to (l2^ and (1271) . respectively. 


July 14, 2015 


DRAFT 












22 


In addition, the optimal transmission powers of Ri and R 2 in successive relaying modes, i.e., 
j and p*^j j, are equal to (l2^ and (1271) . respectively. Accordingly, the properties given in 
Lemma and Lemma |7] also hold in this case. 

Next, we obtain the properties of the power allocation in the multi-access mode. Taking 
derivative of the Lagrangian corresponding to (l2^ with respect to and 


■'r2'fn 


j, and setting them to zero we obtain the following. 
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Here /^er^md’ ^^d are KKT multipliers due to non-negativeness of Cr^rn,i, 

Cr 2 m,i, e.r^m,i and er^rn,i, respectively. 

Similar to Section IV.B, without loss of generality we can restrict our attention to the cases for 
which both Ri and R 2 deliver data to D in the multi-access mode. Then 


and (3e 


m 


are equal to zero. Due to the rate region of multi-access mode defined in 


constraints in (I23bl) - (l23dl) . the constraint (I23bl) and/or (I23cl) can be satisfied with equality, that 
is, Xi^i > 0 and/or A 2 ,j > 0. 

• If Ai^j > 0 and A 2 ,i = 0, then from (|3^-(|361). we obtain 
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If Ai^j = 0 and A 2 ,i > 0, then from (|3^-(|361). we obtain 


yK 


yK 


K 


yK 


^rid 


^r-i d \ ^ IC 


(37) 




r2m,i 


Y.f=i ^7,j + Y.f=i ^w,j - Y.f=i E,j - Y.f=i E,j 

EK \ (^r2d \ 

j=i ^ 2^j=i ^5,j 


(y.r2d 


(38) 


July 14, 2015 


DRAFT 


























23 


where Ylf=i Atj + Ef=i ^w,j > 'Ef=i\j + Ef=i and Ylf=^ Kj > ^f=i 
Ai^i = 0 and X 2 ,i > 0. 

• Otherwise, we have 

1 


p, 


rim,2 


1 “ Ylf=i ^7,j + Ylf=i ^9J ar^d * 


Yl^=i -^5j 


(39) 
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r2m,i 


Yfi=i \j + Yfj=i ^ 


noj 




^r\d 

CXr2d 


P 


* 

rim,2 



(40) 


Using these, we ean identify some properties of the optimal transmission powers of Ri and R 2 
in the multi-aeeess mode. 

Lemma 11: In the optimal transmission poliey for multi-aeeess and multihop with spatial 
reuse, the following must be satisfied in the multi-aeeess mode: 

• If the transmission power of Ri (R 2 ) strietly inereases from epoeh i to i + 1, i.e., < 

Prim,i +1 (Pr 2 m,i < Pr 2 m,i+i)’ ^^en either the data buffer or the battery of Ri {R 2 ) must be 
depleted, or the data buffer of R 2 {Ri) must be full at t = fj. 

• If the transmission powers of both Ri and R 2 strietly deerease from epoeh i to i -f 1, then 
the data buffers of both Ri and R 2 must be full at f = fj. 

Proof: We ean argue that whenever ^ either Ay,* > 0 or As,* > 0, or Aio,j > 0 

in (iJTl) . or either > 0 or As^j > 0, or > P*r 2 mi+i i’^ <l39l) . Similarly we ean argue that 
whenever > Pr^rn,i+o either Xj^i > 0 , Aio,* > 0 or Ag,* > 0 in dM]), or pf^^ < 

or Aio,j > 0 in dlOl). Therefore, we ean eonelude that if the transmission power of Ri strietly 
inereases from epoch z to z -f 1 , then either the data buffer of Ri (A 7 > 0 ) or the battery of Ri 
(Ag^i > 0) must be depleted, or the data buffer of R 2 (A 7 > 0 ) must be full at the end of epoch 
i. Similarly, the proof can be extended for R 2 as well. 

Now suppose that the transmission powers of the both Ri and R 2 strictly decrease from epoch 
z to z-f 1, i.e., pfrn,i > Prim,i +1 ^^d p*r^rn,i > P*r 2 m,i+i- Then, from dH]), wc obscrvc that Ag,* > 0, 
and from (l40l) we see that Aio,i > 0. Therefore, from complementary slackness conditions, we 
can conclude that the data buffers of both Ri and R 2 must be full. ■ 


V. Illustration of Results 

In this section, we provide numerical results to show the effect of the number of relays, energy 
harvesting and relay buffer size on the optimal throughput. We also compare the performances 
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Figure 3. Throughput versus A, energy allocation among the relays. Ri has total energy AEr, R 2 has (1 — A)Er. Qsn = 4, 
crsT -2 — O-rid = 1, and ar^d = 4, T = 10 seconds. For the battery-run (BR) system = 10 Joules and = 11.9 Joules, 
and for the energy harvesting (EH) system Es = [1,1,1,1,1,1, 1,1,1,1] Joules and Er = [0.1, 0.3, 0.3, 0.6, 0.6, 0, 0,1, 4, 5] 
Joules with epoch durations r = [1, 0.6,1.4,1.2, 0.8,1,1.2,1.6, 0.5, 0.7] seconds. 


of various transmission modes in the two relay scenario. 

First, we study the effect of energy harvesting on the throughput of a system with one and 
with two relays. We consider infinite size data buffer at the relays. We set the power gains to 
= 4, ctsrz = Oirid = 1, and ar^d = 4, and the deadline to T = 10 seconds. We consider 
ten epochs with durations r = [1, 0.6,1.4,1.2,0.8,1,1.2,1.6,0.5, 0.7] seconds. We compare the 
throughputs of the following two scenarios: (i) for each terminal there is a single energy arrival 
at f = 0 {battery-run system), (ii) for each terminal there are ten energy arrivals at the beginning 
of the epochs {energy harvesting system). For the battery-run system, we have Egy = 10 Joules, 
Eri,i = \Er, and = (1 — X)Er with 0 < A < 1, 77^ = 11-9 Joules, and Egy = Er^^y = 
Er^y = 0, i = 2,..., 10. For the energy harvesting system, source energy arrivals are Eg = 
[1,1,1,1,1,1,1,1,1,1] Joules, Ri energies are = AEr, and R 2 energies are Era = (1 —A)Er 
with Er = [0.1, 0.3,0.3, 0.6,0.6, 0,0,1,4, 5] Joules. Note that in both systems A = 1 corresponds 
to the single relay model with Ri only, and A = 0 with R 2 only. Also, the total source and 
relay energies are same in the battery-run and energy harvesting systems. The throughputs as a 
function of A for both battery-run and energy harvesting systems are shown in Figure 3. For the 
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Figure 4. Throughput versus relay data buffer size Bmax- Ri has total energy AEr, R 2 has (1 — A)Er, with A optimized in the 
two relay case. Eg = [1,1,1,1,1, 1,1,1,1,1] Joules and E^ = [0.1, 0.3, 0.3, 0.6, 0.6, 0, 0,1,4, 5] Joules with epoch durations 
r = [1, 0.6,1.4,1.2, 0.8,1,1.2,1.6, 0.5, 0.7] seconds, asr^ = 4, Qsr 2 = 1^ Orid = 1, and Orjd = 4, T = 10 seconds. 


case of two relays, we provide the throughputs obtained by optimizing over all four modes, and 
for multi-hop with spatial reuse only. As expeeted, the battery-run system with the same total 
energy performs better than the energy harvesting one. For the ehannel gains in this partieular 
example, having two relays is always better than having one although this may not be true for 
arbitrary ehannel gains due to the energy sharing variable A. In addition, for the battery run 
system, having only i?i results in more throughput than having only R 2 , whieh ean be seen 
by eomparing the throughputs of A = 1 with A = 0. This due to the faet that the available 
energy of S is less than the available energy of the relays; henee, having Ogn > ctrid better 
balanees the throughputs in each hop. However, for the energy harvesting system having only 
Ri results in lower throughput than having only R 2 . This is beeause most of the relay energy 
arrives in the later epoehs and henee a higher power gain between the relay and destination 
is beneficial for the earlier epochs. As shown in the figure, both for the battery run and for 
the energy harvesting systems, the throughputs when all four modes are eonsidered are slightly 
higher than the throughputs of multi-hop with spatial reuse and are equal for large A. This is 
eonsistent with [|5l whieh shows that multi-hop with spatial reuse obtains most of the eapacity 
gains in many seenarios. 
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We investigate the effeet of relay data buffer size on the throughput in Figure 4. We eonsider 
an energy harvesting system and set the power gains, energy arrivals and epoeh durations as 
above. We study three eases: (i) Two relays where the throughput is obtained by optimizing 
over all four transmission modes and energy sharing parameter A, (ii) single relay with Ri only 
(A = 1), (iii) single relay with R 2 only (A = 0). As shown in the figure, data buffer size is more 
detrimental for the single relay ease with i?i than with R 2 . For the ease of two relays, for low 
Bmax, inereasing the data buffer eapaeity leads to a dramatie inerease in the throughput. Unlike 
the seenario with Ri only, the throughput saturates after Bmax > 1-75 bits when we have two 
relays sinee some of the data ean be delivered through R2. 

Next, we eompare performanees of broadeast and multi-hop with spatial reuse, and multi-hop 
with spatial reuse only. We set the power gains to = 2, 0*^2 = 1 , and = 1, and ar2d = 3, 
and the deadline to T = 2 seeonds. We eonsider an energy harvesting system with two energy 
arrivals at the beginning of the epoehs with durations 1 seeonds eaeh. The souree energies are 
Eg = [2.5, 2] Joules, Ri energies are = [0.5,1.5] Joules, and R2 energies are Era = 7?r2,2] 

Joules. Figure 5(a) shows the throughput as a funetion of Er2,2 whieh takes values in the range 
(0.5, 2.5) Joules. Figure 5(b) shows the remaining energy at at T = 2 seeonds for multi¬ 
hop with spatial reuse. For the above energy and ehannel profiles the remaining energy at S 
and Ri are zero. As shown in the figure, when Era ,2 > 0.72 Joules, broadeast and multi-hop 
with spatial reuse performs better than multi-hop with spatial reuse only. This is beeause for 
Era ,2 > 0-72, under multi-hop with spatial reuse protoeol, R 2 has energy left in its battery at 
T = 2 seeonds. Introdueing the broadeast mode allows the source to send more information to 
R2, thereby creating an opportunity for R2 to deplete the remaining energy. 

Finally, we compare performances of multi-access and multi-hop with spatial reuse, and multi¬ 
hop with spatial reuse schemes. We set the power gains to = 5, asr 2 = 1 , Q^nd = 1 , and 
arad = 3, and the deadline to T = 2 seconds. We consider an energy harvesting system with two 
energy arrivals at the beginning of epochs of duration 1 second each. The source energies are 
Eg = [Eg,1,0] Joules, i?i energies are E^ = [0.01,2] Joules, and R2 energies are Era = [0-1,7] 
Joules. In Figure 6, we provide the throughput as a function of Eg,i which takes values in the 
range (4,10) Joules. Note that for the above energy and channel profiles the remaining energy 
at the nodes are zero for both cases. As shown in the figure, multi-access and multi-hop with 
spatial reuse performs better than multi-hop with spatial reuse only. This is due to the fact that 
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(a) 



(b) 

Figure 5. Throughput versus relay energy -Er 2 , 2 - Es = [2.5,2], = [0.5,1.5], Era = [l)Er 2 , 2 ] Joules where Era ,2 

the range (0.5, 2.5). Osri = 2, asr 2 = 1^ cirid = 1, and arad = 3, T = 2 seconds. 


the multi-access mode makes efficient use of the energy of Ri and R 2 to increase the amount 
of data delivered to the destination. 


VI. Conclusion 

In this paper, we have studied energy harvesting two hop communication with half-duplex 
relays. We have considered one and two parallel decode-and-forward relays with finite size data 
buffers employing four transmission modes. Under the assumption of non-causally known energy 
arrivals, we have considered optimal transmission policies to maximize the total data delivered 
by a deadline, and formulated convex optimization problems to compute the throughput. For the 
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Figure 6. Throughput versus source energy -Bs.i- Es = [-Es,i,0] where Es,i is in the range (4,10), = [0.01,2], 

Era = [O-li '^l J- = 5, Qisra = Qrid = 1, and Qrad ~ S, T = 2 seconds. 


case of two relays we have focused on multi-hop with spatial reuse with and without broadcast or 
multi-access modes. In all eases we have identified various properties of the optimal polieies using 
KKT eonditions of the eonvex optimization formulation. Finally, we have provided performanee 
comparisons and investigated the impact of multiple relays, relay data buffer size, transmission 
modes and energy harvesting on the average throughput. Overall, our results suggest that while 
energy harvesting eauses a loss in throughput eompared with the battery operated seenario, by 
proper optimization of the transmission power and schedules, it is possible to obtain signifieant 
gains. Furthermore, simple relaying strategies sueh as multihop with spatial reuse are suffieient to 
obtain a eonsiderable portion of these gains. Possible future extensions inelude designing online 
strategies based on the insights gained from the offline solutions provided here and extensions 
to larger networks involving more relays and more hops. 
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